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SUMMARA' 

During  die  DAKFA  ANN  I  Frograin  contracT,  new  neural  iieiwork  arcliitet  r um  v  -.i.,-;, 
liexeloped  to  carry  out  autonomous  real-time  preproi essing.  segmentatioti.  .'ecnunit ion. 
ing.  and  control  of  both  spatial  and  temporal  input,-..  This  i)rief  summary'  is  hdlov.e.i  a 
tiiore  e.xiensive  one.  whidi  citc's  articles  from  tiie  li.st  of  publications  (pj).  i  (It, 

(1)  Preprocessing  of  visual  form  and  motion  signals:  [Nirallel  c()rti<  al  h  r 

tb.e  proct'ssing  of  static  visual  foritis  anrl  moving  visual  forms  are  derived  from  a  princijiic 
called  FM  Symmetry.  A  solution  of  the  gloltal  motion  segmentation  proltkun  for  comsuiter 
vision  i.s  also  outlined,  a.s  well  as  an  analysis  of  3-D  vision  and  figure-grtjiind  poj)-out  iF.A- 
C.-\DE  theory).  .-\  feedforward  W'hat -and- Where  filter  models  parallel  visual  sv'stems  tii 
generate  an  input  repre.sentation  I'What  it  is)  that  i.s  itivariant  to  position,  size,  and  (trieiita- 
tion  without  discarding  this  information  (Where  it  is).  Synchronized  oscillatiotis  in  a  mode! 
of  visual  cortex  are  capable  of  rapidly  binding  spatially  distributed  feature  detectors  into  ,i 
globally  coherent  segmentation.  .Another  .sy.s'tern  .separate.?  .scenic  figtires  from  each  other  a;,'d 
a  cluttered  background.  The  vision  models  have  Iteen  applied  to  the  analysis  of  bright nf‘s> 
perception,  illusory  cotstours.  feature  birKling.  and  reset.  The  models  have  also  been  api)i!ed 
to  the  processing  of  synthetic  aperture  radar  (S.AR)  images. 

(2)  Preprocessing  of  acoustic  signals:  .A  neural  network  tnodel  for  jtreprocessitig  an 
acoustic  source  generates  a  repre.sentatiori  of  pitch  as  a  spatial  [tattern  that  emerges  from 
a  type  cT  neural  harmonic  sieve.  .Neural  tietworks  are  also  usefi  to  ev.duale  Hid  speaker 
tujrmalization  tnethods  for  vowel  recognition. 

(3)  .Adaptive  pattern  recognition  and  categorization:  Unsiipervised  learning; 

•An  algorithmic  k-arning  system,  callefi  .AKT'J-.A.  achieves  a  2-3  orfler  of  magnitude  .-peed-up 
over  the  .ART  2  recognition  system.  .Another  new  analog  adaptive  resonance  model  ifaz/v 
.ART)  incorporates  (.(uiiputalion.s  from  fuzzy  .-et  theory  into  the  binary  .ART  1  model.  When 
used  as  part  of  a  larger  architecture  for  supervised  learning,  fuzzy  .AR  F  enaldes  the  'i-er  'o 
interpret  vectors  of  learned  adaptive  weights  a.s  if-then  rules,  thus  deliuing  a  .>e!f-organi/.ing 
exp«*rt  system.  .ART  systems  are  also  central  tu  neural  theory  of  visual  search  and  attejitinn 
to  segmentations:  and  to  an  analysis  of  normal  aitd  amnesic  learning. 

(4)  Adaptive  pattern  recognition  and  prediction:  Supervised  learning:  l  lii 

AR'I.Al.AF  anrl  fuzzy  .ARTM.AF’  arehitectures  carry  out  incremental  siiittuvised  leartiing  of 
recognition  categories  arul  mtiltiflirnensional  maps  in  re.spon.se  to  arltitrary  serjiient  es  of  ana¬ 
log  or  binary  vectors.  .A  Minimax  Leartdng  Rule  conjoiritly  minitnizes  predic  tive  (mtoi  anrl 
maxitriize.s  code  ( funpression,  thereby  optimally  .-haping  recognitirtn  categories  to  the  -tati-- 
lics  of  the  inijut  environment.  Bencluiiark  studies  affirm  .ARTM.AF's  power  (ompared  to 
alternative  models  frotii  machine  learning.  genrUic  algorirhtns.  and  tieural  networks,  includ¬ 
ing  application  domains  .^ucT  a.s  large  datat).i.se  analysis,  medical  i)redi(  tion.  ruk*  ext  i  af  t  iuti, 
arifi  proi)abillty  estimation.  Fusion  ,ART.\I,\F  is  a  multi  cdiantn'l  .AHl'M.AF  netwurk  I'mi 
mubi-sen-or  dat,i  fusion,  ,\notber  s\>ii-m  i  .N ITNsd  j  u.Nes  switching  tlicory  to  dc-isti 


neural  networks  with  a  itii’utnuni  liUinoer  oi  it  iiir’i 
prohlenis. 
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(5)  Temporal  patterns,  working  memory,  and  3-D  object  recognition:  Workn ez 

tiieniory  neural  networks,  called  Sustairif'd  Temporal  Order  HKciirrent  iS  rOHK)  models,  i-’i- 
code  the  invariant  temporal  order  of  serpieiuial  events,  with  repeated  (jr  non-repeaied  ite!!;>, 
in  a  manner  that  is  staltle  under  incremental  learnina;  conditions.  .Anotln'r  >s-stetii.  ART 
H.M.AF.  uses  spatial  and  ttunitoral  evidence  aecamnilation  to  improve  .\RT.\1.\P  [jerformam  e 
in  noisy  input  environments.  Both  STORE',  and  .\KT-HiM.\R  sy.stems  are  hnino  ajtplit  1  Oi 
d-D  objec  t  recostnition  problems. 

(6)  Adaptive  timing:  .A  neural  network  circuit  models  adaptive  tiniiri^of  rec oimitiun 
and  reinforcement  learnins;.  The  ntodei  is  closely  linked  to  circuits  in  tlie  hi[)[)ocam})U:'. 

(7)  Adaptive  control:  An  unsupervised  error-based  learning  system  called  ,i  X'citor 
•Associative  Map  (V.AM)  learns  3-D  spatial  representations  and  self-calihratintt  trajeetory 
I'ontrollers  in  robotics  applications.  A  model  of  semsory-motor  control  shows  how  outflow 
eye  movement  commands  can  be  transformed  by  two  stage.')  of  opponent  processiim  into  a 
head-centered  spatial  representation  of  3-D  target  position.  Opponent  procf-.-ing  is  asain 
a  key  elernetit  in  an  analysis  of  arm  movement  data.  .Analysis  (tf  sensory-tnotor  coiifr'»i 
systems  frames  a  model  of  cerehelhr  learning.  .A  model  of  motor  oscillations  simulati'.s 
bimanual  coordination  and  human  and  (juadrijped  gait  transitions.  .Another  system  tTiod<'!> 
handwriting  production,  including  cur.sive  script.  Related  tnodel  projterties  are  used  in  an 
application  to  optimal  control  of  machine  set-up  scheduling. 

These  and  related  projects,  including  model  development,  analysis,  simulation,  aiui  com¬ 
parisons  with  behavioral  and  neural  data,  are  described  below. 

The  contract  has  provided  partial  summer  salary  for  the  two  Principal  Investigators  and 
suppor  for  four  Research  .Assistants,  all  of  whom  are  PhD  students  in  the  Boston  I’niversity 
Department  of  (Cognitive  and  .Neural  .Systems. 


1.  PREPROCESSING  OF  VISUAL  FORM  AND  MOTION  SIGNALS 


(lA)  Why  do  parallel  cortical  systems  exist  fur  the  perception  of  static  form  aiui 
moving  form? 

This  project  analyses  coniputatioiial  projaTiies  that  clariiy  'atiy  iht-  parailri  (  oitifcl  -v, 
teius  n  —  1'?.  V'l  —  MT.  and  \'l  —  C'J  —  }}'['  exist  for  tin-  poiccp! uri!  prur(-on«  nf 
>!atic  visual  forms  and  rnovin?  visual  forms.  A  symmetry  princijrle.  (  .illeh  LM  SymmfM  v, 
predicted  to  lyrrvern  tlie  development  of  these  parallel  cortitvd  svstem-  hy  computin'’  .d’l  pos¬ 
sible  ways  of  symmetrically  gatina;  sustained  cells  with  transient  tells  ,ind  oni<tniz!ii2  tlw'f 
sustained-transient  cells  into  opponent  pairs  of  on-cells:  and  otf-cetls  whose  out  [tut  -itiinii  - 
are  insensitive  to  direction-of-contrast.  This  symmetric  organizatitat  exphuns  how  the  -t.itii 
form  system  (Static  BCS)  generates  emergent  boundary  segmentations  whose  out  pm  >  are 
insensitive  to  direction-of-contrast  and  insensitive  to  tlirection-of-itiotion.  whereii.-  the  mo¬ 
tion  form  system  (Motion  BCS)  generates  emergent  boundary  segment  at  ion>,  who<e  output.- 
are  insensitive  to  direction-of-contrast  but  sensitive  to  direction-of-mot ion.  K.M  Syimue- 
try  clarifies  why  the  geometries  of  static  and  motion  form  perception  dilfer;  for  exatfiple. 
why  the  opposite  orientation  of  vertical  is  horizontal  (90°).  but  the  opposite  direction  o! 
up  is  down  (180°).  Opposite  orientations  and  directions  are  embedded  in  gated  dipolo  op¬ 
ponent  processes  that  are  capable  of  anta.gonistic  rebound.  .Negative  afterimases.  such  a,.- 
the  .MacKay  and  waterfall  illusions,  are  hereby  explained,  as  are  aftereffects  of  lon<’-rari<’c 
apparent  motion.  These  antagonistic  rebounds  help  to  control  a  dynamic  balance  ijetween 
complementary  perceptual  states  of  resonance  and  reset.  Resonance  cooperatively  links  fea¬ 
tures  into  emeigent  boundary  segmentations  via  positive  feedback  in  a  CC  Loop,  and  rc’set 
terminates  a  resonance  when  the  image  changes,  thereby  preventing  massive  smearing  of 
percepts.  These  complementary  preattentive  states  of  re.sonance  and  reset  are  related  to 
analogous  states  that  govern  attentive  feature  integration,  learning,  and  memory  search  in 
.Adaptive  Resonance  Theory.  The  mechanism  used  in  the  VI  —  MT  system  to  aenerate  a 
wave  of  apparent  motion  Itetween  discrete  flashes  may  also  be  used  in  other  cortical  .system.- 
to  generate  spatial  shliTs  of  attention.  The  theory  suggests  how  the  VI  ~  \'2  —  MT  cortic  al 
.stream  helps  to  compute  moving-form-in-depth  and  how  long-range  a[)i)arent  motion  of  il¬ 
lusory  contours  occurs.  These  results  collectively  argue  against  vision  theories  that  cspou.-o 
independent  processing  modules.  Instead,  specialized  subsysterns  interact  to  ovcrcomo  < om- 
putational  uncertainties  and  complementary  deficiencies,  to  cooperatively  bind  feature  s  into 
conte.xt-sensitive  resonances,  and  to  realize  symmetry  'Tint’ples  that  arc  predic  ted  to  'ic.ivcrii 
the  development  of  visual  cortex.  [56-59.  61] 

(IB)  Cortical  dynamics  of  visual  motion  perception;  Short-range  and  long-range 
apparent  motion 

The  theory  of  biological  motion  perception  is  also  used  to  ex|)lain  c  lassical  and  recent 
ciata  about  short-range  and  long-range  aitparerit  motion  percepts  that  have  not  wt  bc-eri 
explained  by  alternative  models.  These  data  inchide  beta  motion;  sjtlit  motion:  samma 
motion  and  reverse-contrast  gamma  motion;  delta  motion:  visual  inertia:  the  tr<m>ition 
from  group  motion  to  element  motion  in  resitonse  to  a  Ternus  display  as  the  interstimulu- 
interval  (ISI)  decreases:  group  motion  in  response  to  a  revcuse-conlrast  Lernus  disjjlay  even 
at  short  ISls;  speed-up  of  motion  velocity  as  interfla.sh  distance  inc  reases  or  flash  duration 
decrease.s;  dependence  of  the  transition  from  element  motion  to  grouj)  motion  on  stimulu.- 
duration  and  size;  various  classical  dependencies  Itetween  flash  duration,  spatial  sejcaration. 
ISl.  anri  motion  threshold  known  as  Korte's  Laws;  dependencf>  of  motion  strcuiitth  on  stimulus 
orientaticjn  and  sjiatial  freciuency;  short-range  and  long-range  form-color  intcuac  t  ions;  and 
binocular  interactions  of  fla.she.s  to  dilferent  eye.s.  [fks  f>f)j 


(IC)  Neural  dynamics  of  global  inotioti  segmentation:  Detection  fields,  aper¬ 
tures,  and  resonant  grouping 

Ihis  project  has  developed  a  taniral  network  inudid  of  iiloljal  nnaion  H‘u,t!!e!i’ at io[;  jiv 
visual  cortex.  Called  the  .\lotioti  Houndary  Contonr  .Sy.-tein  (HC.S).  ilio  liiodej  clarituv  jjiav, 
anihiyuous  local  rnovenients  on  a  coinplex  tnovina;  shape  are  <tcti\fdv  reoryaiii/ed  intn  a  (ii 
herent  global  motion  signal.  I’tdike  many  previous  researchers,  we  atialv.se  liow  a  iutn'ifu] 
motion  signal  i.s  imparted  to  all  regiotis  of  a  tnoving  figure,  not  oidy  to  regions  at  wiiich  sue 
amldguous  motion  signals  exist.  The  model  hereby  suggests  a  .'atlut  ion  tlte  global  apeioire 
problem.  The  Motion  BCS  describes  how  preprocessing  of  motion  signals  t)v  a  .Motion  Oii- 
ented  Contrast  Filter  (MOC  Filter)  is  joined  to  long-range  cooperative  grouping  merhaiii.otis 
in  a  Motion  Cooperative-Competitive  Looi)  (MOCC  Loop)  to  (oniro!  plienoiiiena  .-in  h  .i> 
motion  capture  and  induced  motion.  The  Motion  BCS  is  comptited  in  parallel  with  tluwStatie 
BCS  of  Clrossberg  and  Mingolla  (IbSda.  IdST).  Homologous  properties  of  the  .Moiion 

BCS  and  the  Static  dCS.  specialized  to  process  movement  directions  and  static  (jrientat ion-, 
respectively,  support  a  unified  explanation  of  many  data  about  static  form  perceptioti  and 
motion  form  perception  that  have  heretofore  been  unexplained  or  treated  separately.  I'rcdif  - 
tions  about  microscopic  comjjutational  differences  of  the  parallel  cortit  a!  streams  I'l  —  MT 
and  IT  —  T'i  are  made.  The  .Motion  BCS  ran  coirptute  motion  directions  that  may  be 
synthesized  from  multiple  orientations  with  opposite  directions-of-rontrast.  Interactions  of 
model  simple  cells,  complex  cells,  hypercotnplex  cells,  and  bipole  cells  are  described,  with 
special  emphasis  given  to  new  functional  roles  (direction  disambignation.  induced  motion! 
for  end  stopping  at  rmiltiple  processing  stages  and  to  the  dynamic  interplay  of  spatially 
short-range  and  long-range  interactions.  [6-')-66] 

(ID)  Brightness  perception,  illusory  contours,  and  corticogeniculate  feedback 

.A  neural  network  model  of  early  visual  processing  offers  an  explanation  of  t,'righfne<s 
effects  often  associated  with  illusory  contours.  Top-down  feedback  from  the  model's  artalog 
of  visual  cortical  complex  cells  to  model  latftral  geniculate  nucleus  (L(5X)  cells  are  u.'^ed  !o 
enhance  contrast  at  line  ends  and  other  areas  of  boundary  discontinuity.  The  result  i.s  an 
increase  in  perceived  brightness  outside  a  dark  line  end.  akin  to  what  Kennedy  (1979)  termed 
"Ijrightness  buttons"  in  his  analysis  of  visual  illusions.  When  several  lines  form  a  siiitablp 
configuration,  as  in  an  Ehrenstein  pattern,  the  perceptual  effect  of  enhanced  brightness  f  an 
be  rjuite  strong.  .Model  simulations  show  the  generation  of  brightne.s.s  buttons.  With  the 
LCS  model  cricuitry  embedded  in  a  larger  model  of  preaitentive  vision,  simulations  u^ing 
cornidex  inputs  show  the  interaction  of  the  brightnes.s  Iruttons  with  real  and  illusory  contours. 


(IE)  A  what-and-where  neural  network  for  invariant  image  preprocessing 

The  What-and-Where  filter  is  a  feedforward  neural  network  for  invariant  image  prepro- 
ce.ssing  that  represent.s  the  position,  trrientaf ion,  and  size  of  an  image  figure  (Where  it  i-i 
in  a  multiplexed  spatial  map.  This  map  is  used  to  generate  an  invariant  rf’presemalion  of 
the  figure  that  is  insensitive  to  position,  orientation,  and  size  for  ptirposes  of  pattern  reeog- 
nition  (what  it  is).  multiscale  array  of  oriented  filters,  followeri  by  competition  I'etween 
orientation.s  and  .scales  is  used  to  flefine  the  Where  filter.  [29] 

(IF)  Figure-ground  separation  of  connected  scenic  figures:  Boundaries,  filling-in, 
and  opponent  processing 

.\  tieural  tietwftrk  mfrdel  perforttis  automatic  parallel  separation  of  connef  ted  sfenic  fig 
uif’S  from  one  another  and  from  their  l)af  kgrf)unds.  The  moflel  is  part  of  a,  self-organizing 
architeeture  for  invariant  pattern  recognition  in  a.  cluttered  ('nviromiuMif .  flif'  figure-ground 
separation  [^roffrs.s  iterates  opf-rations  from  a  I'eatiire  ffuitour  Systfun  (F(’S)  and  a  Hound 
ary  ffnitour  System  ( Ht’S).  The  FCS  discoutits  the  illuminant  ami  fills-in  siirf.u'e  propntie-. 
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sttcli  ;ls  hrishtnoss  and  colo!'.  !i>ini>  ihc  di-i  lanitcd  A  Imv  idea  sd  tin*  i'iU  M'.:;, 

is  to  use  filling-in  for  figure-ground  separation.  The  lU'S  irener.Ucs  bound. u  v  .o-mncni  .o  iu:. 
that  define  the  regions  in  which  filling  in  occurs.  I'he  IH'S  is  inodclled  by  a  I'eodfu!  ward 
network,  called  the  CORT-X  2  filter,  that  combines  oriented  re(  (‘ptive  fields  with  !ee!if\  iuii, 
competitive,  and  cooperative  interactions  to  detect,  re2.u!arize.  and  complete  boiind.i!ie>  in 
up  to  50V{'  analog  noise.  This  filter  combities  complement  ary  properties  (T  larue  reiei)ti\  i‘ 
fields  and  small  receptive  fields,  and  of  on-cells  and  olf-cells.  to  u,enerai('  [josit  ion.div  ioiii*- 
accurate  and  less  noisy  boundaries.  Double  opponent  interactions  of  on  (■eH.>  and  otf-(ei!' 
facilitate  separation  of  figures  with  incomplete  (’()RT-.\  boundaries.  The  results  < Tirif-.  winv 
an  FBF  network  can  rapidly  separate  figures  that  humans  cannot  .-ep, irate  durimr  vi'U.il 
search  tasks.  [74-77] 

(IG)  Cortical  dynamics  of  3-D  vision  and  figure-ground  pop-out 

.\  neural  model,  called  FAtAADE  Theory  ( Form-.And-(  olor-.And-DFpth  i,  ^iiows  iiow  ti;e 
parvocellular  processing  streams  from  LGN  to  V4  can  give  rise  to  4-1)  vimal  peieepts  in 
which  figures  pop-out  from  their  backgrounds.  The  model  snggests  how  (ortii  al  mei  ha- 
nisms  such  as  boundary  completion,  texture  segregation,  and  surface  filling-in  .ue  useri  h.ir 
this  purpose.  It  clarifies  how  monocularly  viewed  parts  of  an  image  may  fill-in  the  .uiruci- 
priate  surface  depth  from  contiguous  binocularly  viewed  jiarts  during  DaX  iru  i  .'tereop-i-. 
Other  explanations  include  how  a  ‘2-D  image  may  generate  a  3-D  percept,  how  spatially 
sparse  disparity  cues  can  generate  continuous  surface  representations  at  different  perceived 
depths,  and  how  representations  of  occluded  regions  can  be  cornpleterl  aiul  recognized  vdth- 
out  usually  being  seen.  The  model  has  also  been  used  to  analyse  flat  a  aliout  such  varied 
phenomena  as  illusory  contours,  shape-from-texiure,  visual  persistence,  and  synchronous 
cortical  oscillations.  It  suggests  how  the  brain  uses  computationally  complementary  blob 
and  interblob  processing  streams  wherein  a  hierarchical  resolution  of  uncertainty  generates 
context-sensitive  visual  representations  that  overcome  .several  different  sourc  es  of  local  amifi- 
guity  in  visual  data.  Cortical  circuits  of  simple,  complex,  hypercomplex,  and  hipole  ceils  are 
simulated.  Recent  psychophysical  and  neurobiological  data  relevant  to  model  explanations 
and  predictions  are  summarized.  [60.  62] 

(IH)  Synchronized  oscillations  for  binding  spatially  distributed  feature  codes 
into  coherent  spatial  patterns 

Neural  network  models  are  described  for  binding  out-of-phase  activations  of  spatially 
distributed  cells  into  synchronized  oscillations  within  a  single  processing  cycle.  The.'-^e  result > 
suggest  how  the  brain  may  overcome  the  temporal  "jitter’’  inherent  in  multi-level  jirocessiii? 
of  spatially  distributed  data.  Coherent  synchronous  patterns  of  spatially  distrilmted  fea¬ 
tures  are  formed  to  represent  and  learn  al)oiit  external  objects  and  events.  Temporal  jitter 
thus  does  not  typically  cause  scenic  parts  to  be  combined  into  the  wrong  visual  ubjedv. 
During  preattentive  vision,  such  patterns  may  represent  emergent  boundary  segmental  ions, 
including  illusory  contours.  During  attentive  visual  object  recognition,  such  patterns  mav 
occur  during  an  attentive  resonant  state  that  triggers  new  learning.  Different  properties  of 
preattentive  and  attentive  oscillations  are  predicted,  and  compared  with  neurophysiulogii  al 
data  concerning  rapid  synchronization  of  cell  activations  in  visual  cortex.  [70-73] 


(II)  Cortical  dynamics  of  feature  binding  and  reset 

-Many  properties  of  visual  persistence  are  hypothesized  to  l)e  caused  liy  positive  ferHlhai  k 
in  the  visual  cortical  circuits  that  are  responsible  for  the  l)inding  or  segmentation  of  visual 
features  into  coherent  visual  forms,  with  the  degree  of  persistence  limited  by  circuits  that 
re.set  these  segmentations  at  stimulus  offset.  A  model  of  the  cortical  local  (  irniitry  responsi¬ 
ble  for  such  feature  binding  and  reset  (jiianlitalively  .simulates  iisychophysical  data  >tiowiim 
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iiu  rease  of  persistence  with  s|)atia!  se[)arat ion  of  a  in,i>kiii*t  'tii!iulu>;  [  M'iatinc  of  ;,i  : 
sistence  to  flash  luminance  and  (iuratit)n;  ora'ater  ix.'rsisteiuc  of  illu.-oi  v  (  omoiir>  Uims  roai 
contours,  with  maximal  persistence  at  an  intermerliate  >timulus  duraii'm:  and  depcndcau c 
of  persistence  on  pre-adapted  stimulus  orientation.  Data  concerning  cortical  cell  re,spon^es 
to  illusory  and  real  contours  are  also  analysed,  as  are  alternative  models  of  feature  binding 
and  persistence  properties.  [17-48] 

(IJ)  Processing  of  synthetic  aperture  radar  (SAR)  images  by  the  BCS/FCS 
system 

.An  improved  Boundary  Contour  System  (BCS)  and  Feature  Contour  System  (FCS) 
neural  network  model  of  preatientive  vision  has  been  applied  to  two  large  image.s  containing 
range  data  gathered  by  a  synthetic  aperture  radar  (S.AR)  sensor.  The  goal  of  processina; 
is  to  make  structures  such  as  motor  vehicles,  road,  or  huildings  more  salient  and  more  in- 
terpretahle  to  human  observers  than  they  are  in  the  original  imagery.  Early  prores.sing  by 
shunting  center-surround  networks  compresses  signal  dynamic  range  and  performs  local  ( on- 
trast  enhancement.  Susequent  processing  by  filters  ,sensitive  to  oriented  contrast,  including 
short-range  competition  and  long-range  cooperation,  segments  the  image  into  regions.  Fi¬ 
nally,  a  diffusive  filling-in  operation  within  the  segmented  regions  produces  coherent  visible 
structures.  The  combination  of  BC.S  and  FCS  helps  to  locate  and  enhance  structure  over 
regions  of  many  pixels,  without  the  resulting  blur  characteristic  of  approaches  based  on  low- 
spatial  frequency  filtering  alone.  [46] 
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2.  PREPROCESSING  OF  ACOUSTIC  SIGNALS 


(2 A)  A  neural  network  model  of  pitch  detection  and  representation 

A  neural  network  model  capable  of  sienerat ine,  a  spatial  representai ion  lor  the  ijiuh  of 
an  acoustic  source  has  been  cleveloi)e(!.  The  model,  called  the  S])aiiiil  I’itch  .Xer-vork. 
a  "harmonic  sieve”  mechanism  whereby  the  strengtfi  of  activation  of  a  eiven  pitch  (hpoeriii.' 
upon  a  weishted  sum  of  narrow  regions  around  the  harmonics  of  tht'  nomincd  j)it(  h  \ai'ie. 
A  key  feature  of  the  model  is  that  hiu:her  harmonics  contribute  less  to  a  pitcli  tlian  k.wt-t 
ones.  Suitably  chosen  harmonic  weighting  functions  enable  computer  simulation,'-  tjf  itiii  h 
perception  data  involving  mistuned  components,  .shifted  harn5unir,s.  anri  varitni.-^  ty;>c,>  ui 
continuous  spectra  including  rippled  noi.^e.  It  is  shown  how  the  weighting  functioti>  prod.iuc 
the  dominance  region  and  how  they  lead  to  octave  shifts  of  pitch  in  re^ironse  to  ambiun- 
ous  stimuli.  Xo  explicit  attentional  window  is  needed  to  limit  i)itch  choices  iyv  the  iiujdel. 
.A  method  is  described  for  relating  the  detertninistic  strength-of-a(  tivatiun  pitdt  fmu  -ion 
to  statistical  human  performance  and  for  comparing  the  network  nuKle!  with  (iuhUtciri',- 
statistical  Optimum  Processor  Theory,  [ll-  l')] 

(2B)  Evaluation  of  speaker  normalization  methods  for  vowel  recognition  using 
fuzzy  ARTMAP  and  K-NN 

Fuzzy  .\RTM.\P  and  K-Xearest  Xeighbor  (K-X.X)  categorizers  are  used  to  evaluate  in¬ 
trinsic  and  extrinsic  speaker  normalization  methods.  Each  classifier  is  trained  on  prejjro- 
cessed.  or  normalized,  vowel  tokens  from  about  30%  of  the  speakers  of  the  Peterson-Barney 
database,  then  tested  on  data  from  the  remaining  speakers,  intrinsic  normalization  meth¬ 
ods  include  one  nonscated,  four  psychophysical  scales  (bark,  bark  with  end-correction,  mel. 
ERB),  and  three  log  scales,  each  tested  on  four  different  combinations  of  the  fundamental 
(To)  and  the  formants  (Ei,  Ft,  F3).  For  each  scale  and  frequency  combination,  four  extrinsic 
speaker  adaptation  schemes  are  tested:  centroid  subtraction  across  all  frequencie.s  (US'),  cen¬ 
troid  subtraction  for  each  frequency  (CSi).  linear  scale  (LS),  and  linear  transformation  (LT). 
-A  total  of  32  intrinsic  and  128  extrinsic  methods  are  thus  compared.  Fuzzy  .AKTM.-\P  and 
K-.X.X  show  similar  trends,  with  K-.XX  performing  .somewhat  oetter  and  fuzzy  .ART.M.AP 
requiring  about  I/IO  as  much  memory.  The  optimal  intrinsic  normalization  method  i.s  hark 
scale,  or  bark  with  end-correction,  using  the  differences  between  all  freciuencies  (Diff  .All). 
The  order  of  performance  for  the  extrinsic  methods  is  LT,  CSi.  LS.  and  CS.  with  fuzzy 
.ART.M.AP  performing  best  using  bark  scale  with  Diff  .All.  and  K-.X.X  choosing  psychoi)hysi- 
cal  measures  for  all  except  CSi.  [12] 


3.  ADAPTIVE  PATTERN  RECOGNITION  AND  C  VI  ECRIRIZ  ATION :  I  \- 
SUPERMSED  LEARNING 


(3A)  Fuzzy  ART:  Fast  stable  learning  and  categorization  of  analog  patterns  by 
an  adaptive  resonance  system 

A  fuzzy  Adaptive  Resonance  Theory  (ART)  model  capable  of  rapid  stable  leaniini^  of 
recognition  categories  in  response  to  arbitrary  serpiences  of  analog  or  irinary  input  i)attern^ 
has  been  developed.  Fuzzy  .ART  incorporates  computations  from  fuzzy  .^et  theory  into  the 
.ART  1  neural  network,  which  learns  to  categorize  only  binary  input  patterns.  The  generaliza¬ 
tion  to  learning  both  analog  and  binary  input  patterns  is  achieved  by  replacing  appeararucs 
of  the  intersection  operator  (n)  in  .ART  1  by  the  .MIX  operator  (a)  of  fuzzy  set  theor>,  Tlie 
MIX  operator  reduces  to  the  intersection  operator  in  the  binary  ca.se.  Category  proliferation 
is  prevented  by  normalizing  input  vectors  at  a  preprocessing  stage.  .A  norniahzation  [proce¬ 
dure  called  complement  coding  leads  to  a  symmetric  theory  in  which  the  MIX  operator  i  ai 
and  the  M.AX  operator  (v)  of  fuzzy  set  theory  play  complementary  roles.  Complement  cod¬ 
ing  uses  on-cells  and  ofF-cells  to  represent  the  input  pattern,  and  preserves  individual  feature 
amplitudes  while  normalizing  the  total  on-cell/off-cell  vector.  Learning  is  .stable  because  all 
adaptive  weights  can  only  decrease  in  time.  Decreasing  weights  corresiiond  to  increasing 
sizes  of  category  “boxes”.  Smaller  vigilance  values  lead  to  larger  category  boxes.  Learning 
stops  when  the  input  space  is  covered  by  boxes.  With  fast  learning  and  a' finite  input  set  of 
arbitrary  size  and  composition,  learning  stabilizes  after  just  one  presentation  of  each  input 
pattern.  A  fast-commit  slovv-recode  option  combines  fast  learning  with  a  forgetting  rule  that 
buffers  system  memory  against  noise.  Using  this  option,  rare  events  can  be  rapidly  learned, 
yet  previously  learned  memories  are  not  rapidly  erased  in  response  to  statistically  unreliable 
input  fluctuations.  [36-37] 

(3B)  AFIT  2-A:  An  adaptive  resonance  algorithm  for  rapid  category  learning  and 
recognition 

.ART  2-.A  is  an  efficient  algorithm  that  emulates  the  self-organizing  pattern  recognition 
and  hypothesis  testing  properties  of  the  ART  2  neural  network  architecture,  but  at  a  speed 
two  to  three  orders  of  magnitude  faster.  Analysis  and  simulations  show  how  the  .ART  2-. A 
systems  correspond  to  ART  2  dynamics  at  both  the  fast-learn  limit  and  at  intermediate 
learning  rates.  Intermediate  learning  rates  permit  fast  commitment  of  category  nodes  biit 
slow  recoding,  analogous  to  properties  of  word  frequency  effects,  encoding  specificity  effects, 
and  episodic  memory.  Better  noise  tolerance  is  hereby  achieved  without  a  loss  of  learning 
stability.  The  ART  2  and  ART  2-A  systems  are  contrasted  with  the  leader  algorithm. 
The  speed  of  .ART  2-A  makes  practical  the  use  of  .ART  2  modules  in  large-scale  neural 
computation.  In  particular,  researchers  using  ART  2  for  applications  in  the  DARP.A  .AXXT 
Program  have  used  ART  2-A  for  their  projects.  [34-35] 

(3C)  A  neural  theory  of  visual  search 

.A  neural  theory  is  proposed  in  which  visual  search  is  accomplished  by  perceptual  grou[)- 
ing  and  .segregation,  which  occurs  simultaneously  across  the  visual  field,  and  object  recosni- 
tion,  which  is  restricted  to  a  selected  region  of  the  field.  The  theory  offers  an  alternative  hy¬ 
pothesis  to  recently  developed  variations  on  Feature  Integration  Theory  (Treisrnan  and  .Sato. 
1991)  and  the  Guided  Search  Model  (Wolfe,  Cave,  and  Franzel,  1989).  .A  neural  architecturt' 
and  search  algorithm  is  specified  that  quantitatively  explains  a  wide  range  of  [isycliophysical 
search  data  (Cohen  and  Ivry,  1991;  Mordkoff.  A'antis,  and  Egeth,  1990;  Treisrnan  and  Sato. 
1991;  Wolfe.  Cave,  and  Franzel,  1989).  [67] 
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(3D)  Normal  and  amtiesic  learning,  rerognition.  and  memory  by  a  neural  model 
of  cortico-hippocampal  interactions 

The  processes  by  which  humans  and  other  jn'imates  learn  to  retoHnize  object.-,  have 
been  the  subject  of  many  models.  Proces.ses  such  as  learning,  categorization.  attent!i)»i, 
memory  search,  expectation,  and  novelty  detection  work  together  at  different  stage.s  to  n-alize 
object  recognition.  The  structure  and  function  of  one  such  model  class  (.Adaptive  Rcvscmance 
Theory,  .ART)  are  related  to  known  neurological  learning  and  memory  processe.s.  .suc  h  as 
how  inferotemporal  cortex  can  recognize  both  specialized  and  abstract  information,  and  liuw 
medial  temporal  amnesia  may  be  caused  by  lesions  in  the  hippocampal  formation.  Tin* 
model  also  suggests  how  hippocampal  and  inferotemporal  processing  may  be  linked  during 
recognition  learning.  [20] 
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4.  ADAPTIVE  PATTERN  RECOGNITION  AND  PREDICTION:  SCPER- 
VISED  LEARNING 


(4A)  ARTMAP:  Supervised  real-time  learning  and  classification  of  nonstationary 
data  by  a  self-organizing  neural  network 

A  neural  network  architecture,  called  ARTMAP.  autonomously  learns  to  classify  arbitrar¬ 
ily  many,  arbitrarily  ordered  vectors  into  recognition  categories  based  on  predictive  success. 
This  supervised  learning  system  is  built  up  from  a  pair  of  .Adaptive  Resonance  Theory  tiiud- 
ules  (.ARTa  and  ARTj)  that  are  capable  of  self-organizing  stable  recognition  categories  in 
response  to  arbitrary  sequences  of  input  patterns.  During  training  trials,  the  .ARTa  mod¬ 
ule  receives  a  stream  {alPl}  of  input  patterns,  and  -ARTj  receives  a  stream  {b'TJ}  of  in|)m 
patterns,  where  b^pl  is  the  correct  prediction  given  These  .ART  modules  are  linked  by 
an  associative  learning  network  and  an  internal  controller  that  ensures  autonomous  system 
operation  in  real  time.  During  test  trials,  the  remaining  patterns  are  presented  withoui 
bl/’l,  and  their  predictions  at  .ARTj  are  compared  with  bfPh  Tested  on  a  benchmark  machine 
learning  database  in  both  on-line  and  off-line  simulations,  the  .ARTM.AP  system  learns  or¬ 
ders  of  magnitude  more  ciuickly,  efficiently,  and  accurately  than  alternative  algorithms,  and 
achieves  100%  accuracy  after  training  on  less  than  half  the  input  patterns  in  the  database.  It 
achieves  these  properties  by  using  an  internal  controller  that  conjointly  ma.ximizes  predicti'.e 
generalization  and  minimizes  predictive  error  by  linking  predictive  success  to  category  size  on 
a  trial-by-trial  basis,  using  only  local  operations.  This  computation  increases  the  vigilance 
parameter  pa  of  .ARTa  by  the  minimal  amount  needed  to  correct  a  predictive  errur  at  .ART;,. 
.ARTMAP  is  hereby  a  type  of  seif-organizing  expert  system  that  calibrates  the  selectivity  of 
its  hypotheses  based  upon  predictive  success.  .As  a  result,  rare  but  important  events  can  be 
quickly  and  sharply  distinguished  even  if  they  are  similar  to  frequent  events  with  different 
consequences.  Because  .ARTMAP  learning  is  self-stabilizing,  it  can  continue  learning  one  or 
more  databases,  without  degrading  its  corpus  of  memories,  until  its  full  memory  capacitv  is 
utilized.  [28-32] 

(4B)  Fuzzy  ARTMAP:  A  neural  network  architecture  for  incremental  supervised 
learning  of  analog  multidimensional  maps 

Fuzzy  .ARTM.AP  extends  the  capabilities  of  .ARTM.AP  to  carry  out  incremental  super¬ 
vised  learning  of  recognition  categories  and  multidimensional  maps  in  response  to  arbitrary 
sequences  of  analog  or  binary  input  vectors.  .A  normalization  procedure  called  complement 
coding  leads  to  a  symmetric  theory  in  which  the  .A.\D  operator  (a)  and  the  OR  operator 
(v)  of  fuzzy  logic  play  complementary  roles.  Improved  prediction  is  achieved  by  training 
the  system  several  times  using  different  orderings  of  the  input  set.  This  voting  strategy  can 
also  be  used  to  assign  confidence  estimates  to  competing  predictions  given  small,  noisy,  or 
incomplete  training  sets.  Four  classes  of  simulations  illustrate  fuzzy  .ARTM.AP  performance 
as  compared  to  benchmark  back  propagation  and  genetic  algorithm  systems.  These  simu¬ 
lations  include  (i)  finding  points  inside  vs.  outside  a  circle;  (ii)  learning  to  tell  two  spirals 
apart;  (iii)  incremental  approximation  of  a  piecewise  continuous  function;  and  (iv)  a  letter 
recognition  database.  [19,  21,  24-27] 
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(4C)  Fusion  ARTMAP:  A  neural  network  architecture  for  niulti-channel  data 
fusion  and  classification 

Fusion  ARTMAP  is  a  sclf-ors;aniziii.£;  neural  network  architecture  for  inulti-ciiaiuiei.  or 
uuilti-sensor,  data  fusion.  Single-channel  fusion  ARTM.-\P  i.s  functionally  e(|uivale!it  to  fuz.^y 
.\RT  during  unsupervised  learning  and  to  fuzzy  .ARTM.AP  during  supcrvi.sed  If-artiing.  I'h.- 
neiwork  has  a  symmetric  organization  such  that  each  channel  can  Ire  dynamically  confi'ziirtoi 
to  serve  either  as  a  data  input  or  a  teaching  input  to  the  system.  .An  .ART  module  form.'  a 
compressed  recognition  code  within  each  channel.  These  codes,  in  turn,  become  inputs  to 
a  single  .ART  system  that  organizes  the  global  recognition  code.  When  a  imedicrive  error 
occurs,  a  process  called  parallel  match  tracking  simultaneously  raises  vigilances  in  multiple 
.ART  modules  until  reset  is  triggered  in  one  of  them.  Parallermatch  tracking  lierelyv  reo-!> 
only  that  portion  of  the  recognition  code  with  the  poorest  match,  or  minimum  prt'dietive 
confidence.  This  internally  controlled  selective  reset  process  is  a  type  of  credit  assientnent 
that  creates  a  parsimoniously  connected  learned  network.  Fusion  .ARTM.AP's  multi-chaanf'l 
coding  is  illustrated  by  simulations  of  the  Quadruped  Mammal  database.  [Ij 

(4D)  Comparative  performance  measures  of  fuzzy  ARTMAP,  learned  vector 
quantization,  and  back  propagation  for  handwritten  character  recognition 

•A  simulation  study  compares  the  performance  of  fuzzy  .ART.M.AP  with  that  of  learned 
vector  quantization  and  back  propagation  on  a  handwritten  character  recognition  task. 
Training  with  fuzzy  .ARTM.AP  to  a  fixed  criterion  uses  many  fewer  epochs.  Acting  with 
fuzzv  .ARTM.AP  vieids  the  highest  recognition  rates.  [22] 

(4E)  Rule  extraction  by  fuzzy  ARTMAP 

Knowledge,  in  the  form  of  fuzzy  rules,  can  be  derived  from  a  self-organizing  supervised 
learning  neural  network  called  fuzzy  ART.M.AP.  F  ile  extraction  proceeds  in  two  stages;  prun¬ 
ing  removes  those  recognition  nodes  whose  confix  nee  index  falls  below  a  .selected  thresliold. 
and  a  quantization  of  continuous  learned  weights  allows  the  final  system  state  to  be  trans¬ 
lated  into  a  usable  set  of  rules.  .Simulations  on  a  medical  prediction  problem,  the  Pima 
Indian  Diabetes  (PID)  database,  illustrate  the  method.  In  the  simulations,  pruned  networks 
about  one-third  the  size  of  the  original  actually  show  improved  performance.  Quantization 
yields  comprehensible  rules  with  only  slight  degradation  in  test  set  prediction  performance. 
!:i9i 

(4F)  Medical  database  analysis  and  survival  prediction  by  neural  networks 

Fuzzy  .ARTMAP  has  been  used  for  analysis  of  medical  databases,  with  comparative  .stud¬ 
ies  of  other  neural  networks  and  statistical  methods.  .Survival  prediction  networks  have  been 
derived  from  large  data  sets  for  breast  cancer,  cardiac  bypass  surgery  (CABG).  and  pneu¬ 
monia  patients.  Ongoing  studies  focus  on  problems  of  missing  data  and  rule  ideniifif  atioii. 
(11.  M] 

(4G)  Fuzzy  ARTMAP,  slow  learning,  and  probability  estimation 

-A  nonparametric  probability  estimation  procedure  uses  the  fuzzy  .ART.M.AP  neural  net¬ 
work.  Because  the  procedure  does  not  make  a  priori  assumptions  about  underlying  proba¬ 
bility  distributions,  it  yields  accurate  estimates  on  a  wide  variety  of  prediction  tasks.  Fuzzy 
.ARTM.AP  is  used  to  perform  probability  estimation  in  two  different  modes.  In  a  ■.slow- 
learning"  mode,  input-output  associations  change  slowly,  with  the  strength  of  each  associa¬ 
tion  computing  a  conditional  probability  estimate.  In  “max-nodes'’  mode,  a  fixed  number  of 
categorie.s  are  coded  during  an  initial  fast  learning  interval,  and  weights  are  then  tuned  by 
slow  learning.  Simulations  illustrate  system  performance  on  tasks  in  which  various  numbers 
of  clusters  in  the  set  of  input  vectors  mapiied  to  a  given  riass.  [44] 
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(4H)  Probabilistic  neural  networks  and  calibration  of  supervised  learning  sys¬ 
tems 

Probabilistic,  or  general  regression,  neural  networks  have  been  developed  for  the  cal¬ 
ibration  of  supervised  learning  systems.  training  process  learns  receptive  field  width 
parameters  and  calibrates  predictions  to  reflect  binary  outcome  probabilities.  [79] 

(4l)  Construction  of  neural  network  expert  systems  using  switching  theory 

This  project  introduces  a  new  family  of  neural  network  architectures  (.N'EXsT)  that  use 
switching  theory  to  construct  and  train  minimal  neural  network  classification  expert  sys¬ 
tems.  The  primary  insight  that  leads  to  the  use  of  switching  theory  is  that  the  problem  of 
minimizing  the  number  of  rules  and  the  number  of  IF  statements  (antecedents)  per  rule  in 
a  neural  network  expert  system  can  be  recast  into  the  problem  of  minimizing  the  number 
of  digital  gates  and  the  number  of  connections  between  digital  gates  in  a  Very  Large  Scale 
Integrated  (VLSI)  circuit.  Algorithms  for  minimizing  the  number  of  gates  and  the  number 
of  connections  between  gates  in  VLSI  circuits  are  used,  with  some  modification,  to  gener¬ 
ate  minimal  neural  network  classification  expert  systems.  The  minimal  set  of  rules  that 
the  neural  network  generates  to  perform  a  task  are  readily  extractable  from  the  network's 
weights  and  topology.  Analysis  and  simulations  on  several  databases  illustrate  the  system's 
performance.  [78] 
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5.  TEMPORAL  PATTERNS,  WORKING  MEMORY,  AND  3-D  OBJECT 
RECOGNITION 

(5A)  Working  memory  networks  for  learning  temporal  order  with  application  to 
3-D  visual  object  recognition 

Working  memory  neural  networks,  called  Sustained  Temporal  Order  REcurrent 
(STORE)  models,  encode  the  invariant  tetnporal  order  of  secpiential  evenrs  in  short-term 
memory  (STM).  Inputs  to  the  networks  may  he  presented  with  widely  differing  growth 
rates,  amplitudes,  durations,  and  interstimulus  intervals  without  altering  the  sttjred  ST.M 
representation.  The  STORE  temporal  order  code  is  designed  to  enalde  groupings  of  the 
stored  events  to  be  stably  learned  and  remembered  in  real  time,  even  as  new  events  perturb 
the  system.  Such  invariance  and  st-sbility  properties  are  needed  in  neural  architf'cture.s  which 
self-organize  learned  codes  for  vai  J:)le-rate  speech  perception,  sensory-motor  })lanning.  or 
3-D  visual  object  recognition.  Esing  such  a  working  memory,  a  self-organizing  architecture 
for  invariant  3-D  visual  object  recognition  is  described.  The  new  model  is  based  on  a  model 
of  Seibert  and  Waxman,  which  builds  a  3-D  representation  of  an  object  from  a  temporally 
ordered  sequence  of  its  ‘J-D  aspect  graphs.  The  new  model,  called  an  .ARTSTORE  model, 
consists  of  the  following  cascade  of  processing  modules;  Invariant  Prenrocf^ssor  —  .ART  2  — 
STORE  Model  —  .ART  2  ^  Outstar  Network.  [3-4] 

(5B)  Working  memories  for  storage  and  recall  of  arbitrary  temporal  sequences 

An  extension  of  the  STORE  model  encodes  a  working  memory  capable  of  .storing  and 
recalling  arbitrary  temporal  sequences  of  events,  including  repeated  items.  The  memory 
encodes  the  invariant  temporal  order  of  sequential  events  that  may  be  presented  at  widely 
differing  speeds,  durations,  and  interstimulus  intervals.  This  temporal  order  code  is  designed 
to  enable  all  possible  groupings  of  sequential  events  to  be  stably  learned  and  rernembererl  in 
real  time,  even  as  new  events  perturb  the  system.  [5-6] 

(5C)  ART-EMAP:  Learning  and  prediction  with  spatial  and  temporal  evidence 
accumulation 

ART-EM.AP  is  a  neural  architecture  that  u.ses  spatial  and  temporal  evidence  accumu¬ 
lation  to  extend  the  capabilities  of  fuzzy  ART.MAP.  .ART-EM.AP  coml)ines  supervised  and 
unsupervised  learning  and  a  medium-term  memory  process  to  accomplish  stable  pattern 
category  recognition  in  a  noisy  input  environment.  The  ART-EM.AP  system  features  (i) 
distributed  pattern  registration  at  a  view  category  field;  (ii)  a  decision  (  riterion  for  mapi)ine: 
between  view  and  object  categories  which  can  delay  categorization  of  ambiguous  objects 
and  trigger  an  evidence  accumulation  process  when  faced  with  a  low  confidence  prediction; 
(iii)  a  process  that  accumulates  evidence  at  a  medium-term  memory  (.MTM)  field;  and  fiv) 
an  unsupervised  learning  algorithm  to  fine-tune  performance  after  a  limited  initial  period 
of  supervi.sed  network  training.  ART-EM.AP  dynamics  are  illustrated  with  a  benchmark 
simulation  example.  Applications  include  3-D  object  recrjgnition  from  a  series  of  amlri^uotis 
2-D  views.  [38] 
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6.  ADAPTIVE  TIMING 


(6A)  A  neural  network  model  of  adaptively  timed  reinforcement  learning  and 
hippocampal  dynamics 

A  new  neural  network  models  adaptively  limed  reinforcement  learning.  The  adaptive^ 
timing  circuit  is  suggested  to  exist  in  the  hippocampus,  and  to  involve  convergence  of  den¬ 
tate  granule  cells  on  C.\3  pyramidal  cells,  and  N.MD.A  receptors.  This  circuit  foinis  j)ar* 
of  a  model  neural  system  for  the  coordinated  control  of  recognition  learning,  reinforcement 
learning,  and  motor  learning,  whose  properties  clarify  how  an  animal  can  learn  to  accjiiire  a 
delayed  reward.  Behavioral  and  neural  data  are  summarized  in  support  of  eacli  prot  es.-ing 
stage  of  the  system.  The  relevant  anatomical  sites  are  in  thalamus,  neocortex,  hippocampus, 
hypothalamus,  amygdala,  and  cerebellum,  (.’erebellar  influences  on  motor  learning  are  d!<- 
tinguished  from  hippocampal  influences  on  adaptive  timing  of  reinforcement  learning.  The 
model  simulates  how  damage  to  the  hippocampal  formation  disrupts  ada])tive  tiniing.  elimi¬ 
nates  attentional  blocking,  and  causes  symptoms  of  medial  temporal  amnesia.  Properties  of 
learned  expectations,  attentional  focussing,  memory  search,  and  orienting  reactions  to  novel 
events  are  used  to  analyse  the  blocking  and  amnesia  data.  The  model  also  suggests  how 
normal  acquisition  of  subcortical  emotional  conditioning  can  occur  after  cortical  ablation, 
even  though  extinction  of  emotional  conditioning  is  retarded  by  cortical  ablation.  The  model 
simulates  how  increasing  the  duration  of  an  unconditioned  stimulus  increases  the  amplitude 
of  emotional  conditioning,  but  does  not  change  adaptive  timing;  and  how  an  increase  in  the 
intensity  of  a  conditioned  stimulus  "‘speeds  up  the  clock,”  but  an  increase  in  the  intensity 
of  an  unconditioned  stimulus  does  not.  Computer  simulations  of  the  model  fit  parametric 
conditioning  data,  including  a  Weber  law  property  and  an  inverted  1.’  property.  Both  irri- 
mary  and  secondary  adaptively  timed  conditioning  are  simulated,  as  are  data  concerning 
conditioning  using  multiple  interstimulus  intervals  (ISIs),  gradually  or  abruptly  {'hanging 
TSIs,  partial  reinforcement,  and  multiple  .stimuli  that  lead  to  time-averaging  of  re.sponse.s. 
.Xeurobiologically  testable  predictions  are  made  to  facilitate  further  tests  of  the  model.  Ti-j] 
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7.  ADAPTIVE  CONTROL 


(7A)  Neural  representations  for  sensory-motor  control:  Head-centered  3-D  tar¬ 
get  positions  from  opponent  eye  commands 

This  project  describes  how  corollary  dis(  haru,cs  from  oistflow  eye  rnovemem  <  uimji.uid;' 
can  be  transformed  by  two  stages  of  opi)onent  luniral  processing  into  a  head  ( fiiU-red  reptr.. 
sentatir)!!  of  d-D  target  position.  This  re])r<'sentation  implicitly  defities  a  cyt  lopean  cf  .KM  iimati' 
systetn  whose  variables  appro.ximate  the  binoctdar  vergence  atid  'jtiierical.  hori/anital, 
vertical  angles  with  respect  to  the  oltserver's  head.  Various  psychophysical  data  cotn  erturig 
binocular  distance  perception  and  reaching  behavior  are  clarified  by  this  representat  ioti.  1  lie 
representation  provides  a  fotuuiation  for  learning  head-centered  aiui  l)ody-( entered  iiiv.iiiaiit 
representations  of  both  foveated  and  non-foveated  3-D  target  positions.  It  also  enables  a 
solution  to  be  developed  of  the  cla.ssical  motor  equivalence  [troblem.  whereby  matiy  dilh-retii 
joint  configurations  of  a  redundant  manipulator  can  all  be  used  to  realize  a  desired  trajet  torv 
in  3-D  space,  [o-j] 

{7B)  Emergence  of  tri-phasic  muscle  activation  from  the  nonlinear  interactions 
of  central  and  spinal  neural  network  circuits 

The  origin  of  the  tri-phasic  burst  pattern,  observed  in  the  EMCls  (T  opponent  mus- 
cle,s  during  rapid  .self-terminated  movements,  has  been  controversial,  (.'ornputer  .simulations 
show  that  the  pattern  emerges  from  interactions  between  a  central  neural  trajectory  (on- 
troller  { VITE  circuit)  and  a  peripheral  neuromuscular  force  controller  ( FLETE  circuit  ).  Both 
neural  mociehs  have  Iteen  derived  from  simple  functional  constraints  that  have  led  to  prin¬ 
cipled  explanations  of  a  wide  variety  of  behavioral  and  neurobiological  flata.  including  the 
generation  of  tri-phasic  bursts.  [8j 

(7C)  Cerebellar  learning  in  an  opponent  motor  controller  for  adaptive  load  com¬ 
pensation  and  synergy  formation 

.A  minimal  neural  network  niotlel  of  the  cerebellum  is  embedded  within  a  sensory-neuro¬ 
muscular  control  system  that  mimics  known  anatomy  aiul  (thysiology.  With  this  emicdding. 
cerebellar  learning  promotes  load  compensation  while  aiso  allowing  both  roactivation  .ind 
reciprocal  inhibition  of  .sets  of  antagonistic  muscles.  In  particmiar.  we  show  how  synaptic 
long  term  dejjre.ssion  guided  by  feedback  from  muscle  stretch  recejttors  can  leaf!  to  trans- 
cerebellar  gain  changes  that  are  load-compensating.  It  is  argued  that  the  same  [uotesses 
help  to  adaptively  discover  multi-joint  synergies.  Simulations  of  rapid  single  joint  rotatifin- 
under  load  illustrates  design  feasiltility  and  stability.  [7] 

(7D)  Optimal  control  of  machine  set-up  scheduling 

.An  optimal  control  solution  to  diange  of  macldne  set-up  scheduling  is  demon.-t r.iicd. 
The  model  is  based  on  dynamic  itrogramming  average  cost  per  stage  value'  itc'ratii.m  as  mu 
forth  by  Caramanis  (t  nl.  for  the  2-D  case.  The  clifficulty  with  tlie  optimal  apierotu  h  lie> 
in  the  explosive  computational  growth  of  the  resulting  solution.  .A  method  of  rediKirm  the 
computational  complexity  is  developed  using  ideas  from  Itiology  and  neural  networkh.  .A 
real-time  controller  is  described  that  uses  a  linear  log  representation  of  state'  space,  wiiii 
neural  networks  employed  to  fit  cost  stirfacc-s.  [2] 

(7E)  Vector  associative  maps:  Unsupervised  real-time  error-based  learning  and 
control  of  movement  trajectories 

This  project  has  led  to  the  development  cjf  neural  network  models  for  adaptive  <  ontrol  ut 
arm  movement  trajectories  during  visually  guided  reaching  and.  more  generally,  a  framework 
for  unsiipcTvisecl  real-t  itne  error-l)asc‘d  learning.  ’!  he  models  elarily  how  a  child,  nr  unt  raiinfl 


roliot.  can  U'arn  to  rt'ach  tor  objects  that  it  b  is  >iio\vn  how  u/  i.c-  ; 

arm  movements  lead  to  adaptive  tiininy;  of  arm  control  i)i!rani(’ti‘[s.  i  hc-a-  !iio\ cine;;;  -  ,;i  d 
activate  the  target  position  rt'presentatiuns  that  are  n.>e(i  tcj  learn  tijc  viMio-iuntor  'm::.- 
fonnation  that  controls  visually  guided  reachinu;.  The  .W  lTb  model  an  adaj)tive  ra  u.od 
cirenit  based  on  the  Vector  Integration  to  Enilinrint  (  \  1 1  Ei  model  for  arm  and  s[jee(  h  trajia  - 
tory  generation  of  Bnllock  and  (Jrossberg.  In  the  ’v'lTE  inochd.  a  larget  Position  ('omniami 
(TPC)  represents  the  location  of  the  desired  target.  The  Present  Position  Command  if’Ptb 
encodes  the  present  hand-arm  configuration.  The  .-WdTE  mode!  e.xjdains  how  self-con^i-ovii 
TPC  and  PPC  coordinates  are  autonomously  generated  and  learned.  Learninir,  of  .Wi  FT 
parameters  is  regulated  by  activation  of  a  self-regulating  Endoitenous  Random  Concrator 
(ERG)  of  trainin,a;  vectors.  Each  vector  is  integrated  at  the  PPC.  giving  rise  to  a  movcir.c!.! 
command.  The  generation  of  each  vector  induces  a  complementary  [tostural  pha.'C  durimz 
which  ERG  output  stops  and  learning  occurs.  ERG  outptit  autonomou.sly  .-.toijs  iri  >nc!i  .1 
way  that,  across  trials,  a  broad  sample  of  workspace  target  positions  is  generated,  Learidm! 
of  a  transformation  from  TPC  to  PPG  occurs  using  the  DV  as  an  error  signal  that  is  zeroed 
due  to  learning.  This  learning  scheme  is  called  a  \'ector  .-X.ssociative  .Maj),  or  \'.\.\1.  Th(‘ 
v’.A.M  model  is  a  general-purpose  device  for  autonomous  real-time  error-based  learnima  atid 
performance  of  associative  maps.  V,\Ms  tlius  provide  an  on-line  unsuj)ervised  alternati'.e 
to  the  off-line  properties  of  supervised  error-correction  learning  algorithms.  models 

and  .Adaptive  Resonance  Theory  (.ART)  models  e.xhibit  complementary  matching,  learn¬ 
ing.  and  performance  properties  that  together  provide  a  foundation  for  de,signing  .1  oita! 
sensory-cognitive  and  cognitive-motor  autonomous  system.  [4b--')2] 


(7F)  A  neural  pattern  generator  that  exhibits  bimanual  coordination  and  human 
and  quadruped  gait  transitions 

•A  neural  pattern  generator  is  based  upon  a  nonlinear  cooperative-competitive  feedback 
neural  network.  The  sy.stent  can  generate  two  standard  human  gaits;  the  walk  and  the  run. 
.A  scalar  arousal  or  CIO  signal  causes  a  bifurcation  from  one  gait  to  the  next.  .Altlionafi 
these  two  gaits  are  qualitatively  different,  they  both  have  the  same  limb  order  ami  tnav 
exhibit  oscillation  frcciuencies  that  overlap.  The  model  simulates  the  walk  and  the  run  vi,i 
(jualitatively  different  waveform  shapes.  Tlie  fraction  of  cycle  that  activity  is  above  thre.dioid 
(iistinguishes  the  two  gaits,  much  as  the  duty  cycles  of  the  feet  are  longer  in  the  walk  tlian 
in  the  run.  The  two-channel  version  of  the  model  simulates  data  from  human  bimaiiiia! 
coordination  tasks  in  which  anti-pliase  oscillations  at  low  frecpiencies  spontaneoiisly  switch 
to  in-jthase  oscillations  at  high  frequencies,  in-phase  oscillations  can  Ije  i)erforme(l  at  boti; 
low  and  high  frecpiencies.  phase  fluctuations  occur  at  the  anti-phase  to  in-])hase  transition.', 
and  a  "seagul!  effec  t"  of  larger  errors  oceuns  <it  intermediate  pfiases,  In  a  four-i  hantic4  ni'Mr.d 
pattern  generator,  botfi  the  frecpiency  and  the  relative  phase  of  o.s(il!at ions  are  eoiu 
iiy  scalar  arousal.  The  generator  is  used  to  simulate  ciuadruped  gaits:  in  particular.  ra[)id 
ransitions  are  simulated  in  the  order— walk,  trot,  pace,  and  gallop- -that  occurs  in  ih<'  < 
Precise  switching  control  is  achieved  by  using  an  arousal  dependent  modulaticrn  of  r  he*  ni'  idci’- 
irihibitory  interactions.  This  rnocluiation  genertites  a  clilferent  functional  connect iviiv  m  a 
.'ingle  network  at  different  arousal  levels.  [■lO-bf] 


(7G)  VITEWRITE:  A  neural  network  model  for  handwriting  production 

.A  tipi'ral  network  model  called  VITEWRITE  is  shown  to  generate  handwritiria  move 
merits.  The  moclej  (■{insists  of  a  se(|uential  controller,  or  motor  program,  t  hat  interac  t.'  wit  h  a 
trajectory  generator  to  move  a  hand  with  redunclaiit  degrc'es  cif  freedom.  I  hc-  neural  trajer 
tcjry  generator  is  thc>  Vector  Integration  to  Endpoint  (VITE)  rnoclel  for  .'vnclironou.'.  vanaiiie 
sjieed  control  of  rnultijoint  movements.  VITE  jiroperties  enalile  a  sim|)le  cont rol  'trateizc'  tn 
generate  complex  handwritten  scriyit  if  the*  hand  model  contains  rc'dnndant  degicx-s  ol  fo  e 
dorn.  The  proposexi  ecuitroller  launchevs  transicuit  dirc*ctional  commamis  to  itidepcmdem  !.,ind 
synergies  at  times  whc'n  tfie  hand  begins  tci  move,  or  when  a,  veloc  ity  |ieak  in  a  given  -;sne!i!'s 


is  achieved.  The  VITE  model  transhu<'s  those  temporally  disjoint,  .'  .  lu'tey  ( (inm:.!:;!:-  OiOi 
smooth  curvilinear  trajectories  among  temporally  overlai)ping  syneraetic  movemeta ,  .  1 
separate  “score'’  of  onset  times  used  in  most  prior  models  is  hereljv  replaeofi  by  a  '■elf  .'caliaa 
activity-released  “motor  program"  that  uses  few  memory  resourct's.  enables  (•ach  ^yneray 
to  exhibit  a  unimodel  velocity  profile  during  any  stroke,  generates  letters  iliai  are  invariant 
under  speed  and  size  rescaling,  and  enables  effortless  connection  of  letter  shape.s  into  uord.^. 
■Speed  and  size  rescaling  are  achieved  by  scalar  (JO  and  ClRO  signals  that  expte.'S  (()m}>u- 
tationally  simple  volitional  commands.  Psychophysical  data  conccrnimi  hand  movemc!!t>. 
such  as  the  isochrony  principle,  asymmetric  velocity  profiles,  and  the  tw(j- thirds  pov.(>r  law 
relating  movement  curvature  and  velocity  arise  as  emersent  properties  of  model  interactiotss. 
[9-10] 


